FIG. 1 



A SYSTEM FORFORMING SYNCHRONOUS 

INFORMATION OF MELODY 

Filing date: October 21, 2003 
Alan J. Kasper 202-663-7903 

1 of 5 



10 



sound (melody) 
data 



12 



image data 



14 



schedul e 
program 



20 



schedule 
making means 



-16 



melody and image 
information source 



30 



event timing 
detecti on 
menas 



event 
timing 



image timing 
control means 



40 



asynchronous 
system 



sound(mel ody) 
generator 



70 

out put 

-4 



asynchronous ^50 
system 



image 
generator 



60 



panel 

80 



FIG. 2 



Time 
0 



event A 




A SYSTEM FOR FORMING SYNCHRONOUS 

INFORMATION OF MELODY 

Filing date: October 21, 2003 
Alan J. Kasper 202-663-7903 
2 of 5 



FIG. 3 



C 



start 



s 1 01 



creation of a melody 
reproduction schedule 



- SI 02 

detection of 
. event information in melody^ , 
information m 

YES 



delivery of the event 
information to the image 
timing control means 



S 1 "06 



an instruction for 
image renewal is issued 
to an image generator 



S107 



renewal of images 



S108 



displaying renewed 
i mages 



s 1 o 3 



delivery of the melody 
information to a 
melody generator 



SI 04 



outputting melody 



(" completion J 



FIG. 4 



J till iii-/rv y/ow^ 

A SYSTEM FOR FORMING SYNCHRONOUS 

INFORMATION OF MELODY 

Filing date: October 21 , 2003 
Alan J. Kasper 202-663-7903 
3 of 5 



10B 



image data 



40 



image timing 
control means 



60 



image 
generator 



10A 



schedul e 
data 



timing event 
information 



30 



melody data 
+ 

event data 
+ 
time 



event timing 
detecti on 
means 



50 



melody 
generator 



tempo 



panel 

80 



speaker 

70 



FIG. 5 



start 



Jun 1IDA Q7803:> 

A SYSTEM FOR FORMING SYNCHRONOUS 

INFORMATION OF MELODY 

Filing date: October 21, 2003 
Alan J. Kasper 202-663-7903 
4 of 5 



-■$201 

detection of 
"event information in melody^ 
information ^ Hu 

YES 



del i very' of the event 
information to the image 
timing control means 



S205 



. an instruction for 
image renewal is issued 
to the image generator 



$206 



renewal of images 



S207 



displaying renewed 
images 

[ compl etionl 



s 2 02 



delivery of the melody 
information to the 
melody generator 



S 203 



outputting melody 



FIG. 6 



A SYCTEM^FOR FORM ING SYNCHRONOUS 

INFORMATION OF MELODY 

Filing date: October 21, 2003 
Alan J. Kasper 202-663-7903 

5 of 5 



MFi 

(melody data) 



image "data 




JAVA program 
(operation schedule) 



event timing infor nation 



Time 
0 



eve it timi 



ig info -nation 



event timi 



synthesi zed 
melody data 



ng infor nation 

<> 
Time 
t 



FIG. 7 



start 
mel ody 

moving picture image 
timer (playtime) 



-Q 



frame advance 

& — 



/ / / / 



'///, 



occurrence of 
time lag 



